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Background: 

Bayesian  hierarchical  modeling  and  reduced  order  filtering  strategies  have  been  developed  with 
some  success  in  these  extremely  complex  systems.  The  basis  for  such  dynamic  prediction 
strategies  for  the  complex  spatially  extended  systems  is  the  classical  Kalman  filtering  algorithm. 

Objective: 

Many  contemporary  problems  in  science  ranging  from  the  spread  of  hazardous  chemical  or 
nuclear  plumes  to  protein  folding  in  molecular  dynamics  to  scale  up  of  small  scale  effects  in 
nanotechnology,  to  making  accurate  predictions  of  the  coupled  atmosphere-ocean  system  involve 
partial  observations  of  extremely  complicated  systems  with  many  degrees  of  freedom.  There  is  a 
practical  need  to  develop  accurate  real-time  predictions  of  these  extremely  complex  multi-scale 
dynamical  systems  with  many  degrees  of  freedom.  Novel  mathematical  issues  arise  in  the 
attempt  to  quantity  the  behavior  of  such  complex  multi-scale  systems.  For  example,  in  the 
coupled  atmosphere-ocean  system,  the  current  practical  models  for  prediction  of  both  weather 
and  climate  involve  general  circulation  models  where  the  physical  equations  for  these  extremely 
complex  flows  are  discretized  in  space  and  time  and  the  effects  of  unresolved  processes  are 
parametrized  according  to  various  recipes;  the  result  of  this  process  involves  a  model  for  the 
prediction  of  weather  and  climate  from  partial  observations  of  an  extremely  unstable,  chaotic 
dynamical  system  with  several  billion  degrees  of  freedom.  New  mathematical  issues  arise  in  the 
practical  application  of  these  filtering  strategies  to  complex  spatially  extended  systems  in  order 
to  do  rapid  prediction  including  assessments  of  uncertainty  from  model  error  and  parameter 
estimation  and  this  is  the  focus  for  the  present  seed  proposal. 

Approach: 

Novel  Approaches  to  Issue  #1  Practical  Mathematical  Criteria  for  Increasing  Filter 
Ensemble  Size:  The  PI  has  been  developing  a  new  mathematical  theory  to  address  the 


possibilities  for  using  such  radical  numerical  strategies  to  increase  ensemble  size.  One  of  the 
Pi’s  reference  contains  the  first  elementary  mathematical  theory  supporting  this  possibility  and 
an  explicit  demonstration;  utilizing  this  theory  demonstrating  stable  accurate  filtering  (with  a 
single  ensemble  member!)  with  a  strongly  unstable  difference  approximation  to  a  stochastic 
advection-diffusion  equation.  The  failure  of  standard  observability  criteria  as  guidelines  is 
noted.  The  PI  has  developed  a  new  mathematical  theory,  mimicking  von  Neumann  stability 
analysis  for  difference  equations,  for  stable  accurate  filtering  with  unstable/stable  difference 
approximations  to  stochastic  PDE’s.  Such  a  theory  is  not  obvious  since  filtering  algorithms  are 
nonlinear  and  provides  the  hope  to  provide  realistic  offline  test  criteria  as  mathematical 
guidelines.  It  is  shown  how  unstable  difference  approximations  can  nevertheless,  result  in  a 
small  mean  model  error  as  an  application  of  the  theory. 

Novel  Approaches  to  Issue  #2  Information  Flow  in  Complex  Systems:  The  PI  has  been 
developing  techniques  utilizing  information  theory  in  a  computationally  feasible  fashion  in 
systems  with  many  degrees  of  freedom  and  with  large  or  small  ensemble  sizes  in  prediction; 
these  techniques  have  been  tested  and  validated  on  many  degrees  of  freedom  long-range  forecast 
models  for  the  atmosphere  as  well  as  toy  models  in  several  contexts.  There  are  important 
challenges  involving  information  flow  between  components  of  complex  subsystems  to  quantify 
model  error  in  filtering,  prediction,  and  parameter  estimation.  The  PI  has  two  very  recent  books 
discussing  applications  of  information  theory  for  complex  systems. 

Novel  Approaches  to  Issues  #3:  The  PI  and  co  PI  have  developed  mathematical  theories  for 
stochastic  mode  reduction  over  many  years  and  applied  them  to  realistic  dynamical  core  models 
for  the  atmosphere  with  thousands  of  degrees  of  freedom  where  statistically  accurate  reduced 
stochastic  models  involve  roughly  ten  or  less  degree  of  freedom  have  been.  The  PI  has 
developed  novel  methods  for  coarse-graining  stochastic  lattice  models  (Markov  jump  processes) 
coupled  to  large  scale  equations  with  an  enormous  increase  in  computational  efficiency  (factors 
of  tens  of  thousands  to  a  billion!).  This  is  an  active  enterprise  of  the  Pi’s  which  directly  impacts 
these  issues. 

Novel  Approaches  to  Issue  #4:  Numerical  techniques  for  multiscale  dynamical  systems  with 
stochastic  effects.  The  co-PI  has  introduced  new  kind  of  numerical  methods  for  multiscale 
dynamical  systems  with  stochastic  effects.  These  methods  build  on  limit  theorems  for  singularly 
perturbed  Markov  processes,  originally  developed  in  the  70s  by  Khasminskii,  Kurtz, 
Papanicolaou,  etc.  Under  suitable  assumptions,  these  limit  theorems  provide  one  with  closed 
effective  equations  for  the  slow  variables  in  the  system;  the  coefficients  in  these  equations  are 
given  by  expectations  over  the  statistics  of  the  fast  variables  conditional  on  the  value  of  the  slow 
variables.  In  general,  these  expectations  cannot  be  computed  analytically,  but  it  is  possible  to 
estimate  them  on-the-fly  when  needed  via  short  runs  of  the  fast  variables.  Once  this  is  done,  the 
slow  variables  can  be  evolved  using  the  effective  equations  by  one  macro-time-step,  and  the 
procedure  can  be  repeated.  Overall,  the  numerical  cost  of  the  algorithm  is  independent  of  the 
small  parameter”  e<  1  measuring  the  separation  of  time  scale  between  the  fast  variables  in  the 
system  and  the  slow  ones;  in  contrast,  the  cost  of  standard  numerical  schemes  scales  as  e-1 .  In  a 
series  of  works  the  co-PI  has  shown  that  these  new  numerical  procedures  are  effective  in  various 
contexts,  including  polymeric  fluids.  The  co-PI  has  also  shown  that,  in  certain  situations,  these 
new  numerical  procedures  can  be  made  seamless  in  the  sense  they  can  be  applied  to  systems  in 


which  slow  and  fast  variables  exist  but  are  not  known  explicitly.  The  only  requirement  thing  is 
that  it  be  possible  to  partition  the  velocity  fields  driving  the  system  into  fast  and  slow 
components.  This  is  clearly  a  very  suitable  property  as  the  identification  of  the  slow  and  fast 
variables  is  often  very  difficult  in  realistic  systems,  whereas  the  amplitude  of  the  driving  field  is 
usually  readily  accessible.  We  propose  to  pursue  the  developments  of  new  techniques  in  this 
direction. 

Accomplishments: 

Mathematical  guidelines  to  guarantee  accurate  statistical  filtering  in  real  time  for  complex 
dynamical  systems  with  many  degrees  of  freedom;  Assessments  of  stochastic  mode  reduction 
and  “on  the  fly”  numerical  procedures  for  complex  multi-scale  models.  These  results  include 
model  error,  the  role  of  ensemble  size,  parameter  estimation,  etc.  Applications  to  complex 
prototype  problems  in  atmospheric  science,  biological  systems,  material  science,  etc. 
demonstrating  statistical  filtering,  etc. 

Publications: 


•  (with  C.  Franzke,  D.  Crommelin,)  "Normal  Forms  for  Reduced  Stochastic  Climate 
Models,"  PNAS,  March  2009,  Vol.  16,  no.  10,  pp.  3649-3653 

•  (with  R.  Abramov,)  “New  Algorithms  for  Low  Frequency  Climate  Response,”  /  Atmos. 
Sci.,  Vol.  66,  Issue  2,  February  2009,  286  -  309 

•  (with  S.  Stechmann,)  “A  Simple  Dynamical  Model  with  Features  of  Convective 
Momentum  Transport,”/.  Atmos.  Sci.,  Vol.  66,  Issue  2,  Feb  2009,  373  -  392 

•  (with  Y.  Xing,  M.  Mohammadian,)  “Vertically  Sheared  Horizontal  Flow  with  Mass 
Sources:  A  Canonical  Balanced  Model,”  GAFD,  Vol.  102,  Issue  6,  December  2008,  pp. 
543-591 

•  (with  S.  Stechmann,)  "Stochastic  Models  for  Convective  Momentum  Transport,"  PNAS , 
November  2008,  Vol.  105,  no.  46,  pp.  17614-  17619 

•  (with  B.  Khouider,)  “Equatorial  Convectively  Coupled  Waves  in  a  Simple  Multicloud 
Model,”  /.  Atmos.  Sci.,  Vol.  65,  Issue  1 1,  November  2008,  pp.  3376-3397 

•  (with  B.  Gershgorin,)  “A  Nonlinear  Test  Model  for  Filtering  Slow-Fast  Systems,”  Comm. 
Math.  Sci.,  Vol.  6,  Issue  3,  September  2008,  pp.  61 1-649 

•  (with  A.  Gritsoun,  G.  Branstator,)  “Climate  Response  of  Linear  and  Quadratic 
Functionals  using  the  Fluctuation  Dissipation  Theorem,”/.  Atmos.  Sci.,  Vol.  65,  Issue  9, 
Sept  2008,  pp.  2824-2841 

•  (with  C.  Franzke,  B.  Khouider,)  “An  Applied  Mathematics  Perspective  on  Stochastic 
Modelling  for  Climate,”  Phil.  Trans.  Roy.  Soc.,  Vol.  366,  (1875),  July  2008,  pp.  2427  - 
2453 

•  (with  X.  Wang,)  “A  Note  on  the  Emergence  of  Large  Scale  Coherent  Structure  under 
Small  Scale  Random  Bombardments:  The  Discrete  Case,”/.  Math.  Phys.,  Vol.  48,  June 
2007, 

•  (with  J.  Harlim,)  “Filtering  Nonlinear  Dynamical  Systems  with  Linear  Stochastic 
Models,”  Nonlinearity,  21,  Issue  6,  June  2008,  1281  -  1306 

•  (with  S.  Stechmann,  B.  Khouider,)  “Nonlinear  Dynamics  of  Hydrostatic  Internal  Gravity 
Waves”  Theoretical  and  Computational  Fluid  Dynamics,  May  2008,  22:  pp.  407  -  432 


•  (with  J.  Harlim,)  “Mathematical  Strategies  for  Filtering  Complex  Systems:  Regularly 
Spaced  Sparse  Observations,”  /  of  Comp.  Phys.,  Vol.  227,  Issue  10,  May  2008,  pp.  5304 
-5341 

•  (with  C.  Franzke,  D.  Crommelin,  A. Fischer,)  “A  Hidden  Markov  Model  Perspective  on 
Regimes  and  Metastability  in  Atmospheric  Flows,”/.  Climate,  Vol.  21,  Issue  8,  April 
2008,  pp.  1740-1757 

•  (with  O.  Pauluis,  D.  Frierson,)  “Precipitation  fronts  and  the  reflection  and  transmission  of 
tropical  disturbances,”  Quarterly  J.  of  Roy.  Met.  Soc.,Vol.  134,  Issue  633,  April  2008, 

Part  B,  pp.  913  -930 

•  (with  E.  Castronovo,  J.  Harlim,)  “Mathematical  Test  Criteria  for  Filtering  Complex 
Systems:  Plentiful  Observations,”  J.  of  Comp.  Phys.,  Vol.  221,  Issue  7,  March  2008,  pp. 
3678  -  3714 

•  (with  B.  Khouider,)  “  Multicloud  Models  for  Organized  Tropical  Convection:  Enhanced 
Congestus  Heating,”  J.  Atmos.  Sci.,  Vol.  65,  Issue  3,  March  2008,  pp.  895  -  914 

•  (with  A.  Dutrifoy,  S.  Schochet,)  “A  Simple  Justification  of  the  Singular  Limit  for 
Equatorial  Shallow-Water  Dynamics,”  CP  AM,  Vol.  LXI,  March  2008,  pp.  0002  -  0012 

•  (with  R.  Abramov,)  “New  Approximations  and  Tests  of  Linear  Fluctuation-Response  for 
Chaotic  Nonlinear  Forced-Dissipative  Dynamical  Systems,”/.  Nonlinear  Sci.,  Vol  18, 
pp.  303-341,2008 

•  (with  R.  Abramov,)  “Blended  Response  Algorithms  for  Linear  Fluctuation-Dissipation 
for  Complex  Nonlinear  Dynamical  Systems,”  Nonlinearity,  20,  Issue  12,  December  2007, 
2793-2821 

•  (with  C.  Franzke,  G.  Branstator,)  “The  Origin  of  Nonlinear  Signatures  of  Planetary 
Wave  Dynamics:  Mean  Phase  Space  Tendencies  and  Their  Information,”  J.  Atmos.  Sci., 
Vol.  64,  Issue  1 1,  November  2007,  pp.  3987-4003 

•  (with  A.  Dutrifoy,)  “Fast  Wave  Averaging  for  the  Equatorial  Shallow  Water  Equations,” 
Comm.  PDE,  Vol.  32,  Issue  10,  October  2007,  pp.  1617  -  1642 

•  “Multiscale  Models  with  Moisture  and  Systematic  Strategies  for  Superparameterization,” 
/.  Atmos.  Sci.,  Vol.  64,  Issue  7,  July  2007,  pp.  2726  -  2734 

•  (with  J.  Harlim,)  “Information  flow  between  subspaces  of  complex  dynamical  systems,” 
PNAS,  Vol.  104,  23,  June  2007,  pp.  9558  -  9563 

•  (with  S.  Stechmann,  B.  Khouider,)  “Madden-Julian  Oscillation  analog  and  intraseasonal 
variability  in  a  multicloud  model  above  the  equator,”  PNAS,  June  2007,  104,  9919-9924 

•  (with  J.  Biello,  M.  Moncreiff,)  “Meridional  momentum  flux  and  superrotation  in  the 
multi-scale  IPESD  MJO  model,"  J.  Atmos.  Sci.,  Volume  64,  Issue  5,  May  2007,  pp. 
1636-1651 

•  “New  Multiscale  Models  and  Self-Similarity  in  Tropical  Convection”,  J.  Atmos.  Sci., 
April  2007,  Volume  64,  Issue  4,  pp.  1393-1404 


